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@Root Source Analysis/ ValuStream™ — a Methodology for 
Identifying and Managing Risks 

Root sources of uncertainty are taken into account in a rigorous, systematic way. 

M arshall Space Flight Center, Alabama 


Root Source Analysis (RoSA) is a sys- 
tems-engineering methodology that has 
been developed at NASA over the past 
five years. It is designed to reduce costs, 
schedule, and technical risks by systemat- 
ically examining critical assumptions and 
the state of the knowledge needed to 
bring to fruition the products that satisfy 
mission-driven requirements, as defined 
for each element of the Work (or Prod- 
uct) Breakdown Structure ( WBS or PBS) . 
This methodology is sometimes referred 
to as the ValuStream method, asinherent 
in the processisthe linking and prioritiz- 
ing of uncertainties arising from knowl- 
edge shortfalls directly to the customer's 
mission driven requirements. RoSA and 
ValuStream are synonymous terms. 

RoSA isnot simplyan alternate or im- 
proved method for identifying risks. It 
represents a paradigm shift. The em- 
phasis is placed on identifying very spe- 
cific knowledge shortfalls and assump- 
tionsthat are the root sources of the risk 
(the "why"), rather than on assessing 
the WBS product(s) themselves (the 
"what"). In so doing RoSA looksforward 
to anticipate, identify, and prioritize 
knowledge shortfalls and assumptions 
that are likely to create significant un- 
certainties risks (as compared to Root 
Cause Analysis, which is most often used 
to look back to discover what was not 
known, or was assumed, that caused the 
failure). Experience indicates that 
RoSA, with its primary focus on assump- 
tions and the state of the underlying 
knowledge needed to define, design, 
build, verify, and operate the products, 
can identify critical risks that historically 
have been missed by the usual ap- 
proaches (i.e., design review process 
and classical risk identification meth- 
ods). Further, the methodology answers 
four critical questionsfor decision mak- 
ers and risk managers: 

1. What's been included? 

2. What's been left out? 

3. H ow has it been validated? 

4. Has the real source of the uncer- 
tainty/risk been identified, i.e., isthe 


perceived problem the real problem? 

U sers of the RoSA methodology have 
characterized it as a true "bottoms up" 
risk assessment. The insights gained re- 
garding specific shortfalls (risks) in the 
underlying knowledge base are particu- 
larly important to decision makers in de- 
termining the readiness to proceed at 
major decisional milestones in the lifecy- 
cle of a program. 

With RoSA the granularity of the as- 
sessment is taken to the level where one 
can see and assess the driving assumptions 
and state of the knowledge on which the 
program management and engineering 
rests, relative to specific customer-driven 
requirements. The methodology uses a 
knowledge matrix or grid. 

The left side of the matrix is the pro- 
gram/project WBS (or PBS), which is 
the hierarchy of products, created bythe 
designers, that are needed to satisfy mis- 
sion requirements. The top of the ma- 
trix is a Capability Breakdown Structure 
(CBS), which is a hierarchy of the pro- 
grammatic and/ or technical disciplines, 
filled by engineers/ scientists (termed 
Functional Discipline Specialists, FDS's), 
that provide the underlying knowledge 
needed to bring the product to fruition. 
The cells of the matrix are the individual 
knowledge elements needed for mission 
success. The FDS's assess the current 
state of the knowledge for each element 
and identify knowledge shortfalls that 
could significantly affect attainment of a 
customer's goals and requirements. 
These root sources of uncertainties are 
characterized as specific, act/onaWeshort- 
fallsin the analytical toolsand databases, 
and fabrication verification and opera- 
tions capabilities needed to provide the 
products that fulfill the customer's ex- 
pectations. In the process, critical as- 
sumptions are also assessed, and stan- 
dardized, discipline-unique capability 
readiness level (CRL) scales are used to 
quantify the readiness levels and to in- 
sure consistency. Once identified, these 
shortfalls and critical assumptions are 
analyzed in an interactive, multidiscipli- 


nary process that yields prioritized lists 
of risks and recommended mitigating 
actions. 

Results from a RoSA assessment con- 
stitute a basic input into risk -manage- 
ment plans and technology plans and 
metrics. A part of the process is an in- 
teractive session involving both the 
FDS's (who tend to be technologically 
conservative) and the designers (who 
tend to be optimistic) .This interaction 
between the two different perspectives 
significantly increases the validity of in- 
formation. 

RoSA isuseful for identifying risks at any 
stage of the life cycle of a program or proj- 
ect. It has shown itself to be effective in val- 
idating the ach ievabi lity of requirements 
and in identifying and prioritizing root 
so u rces of u n certai n ti es/ ri sks ( i .e. , th e roo t 
sources of unreliability) in hard- 
ware/ software from definition through de- 
sign, as well as in fabrication, verification, 
and operations processes It offers a truly 
independent validation of the technology 
readiness level (TRL) estimates, whether 
considering heritage hardware, commer- 
cial off-the-shelf (COTS), modified off-the- 
shelf (MOTS), or insertion of a new tech- 
nology, by comparing TRL estimates made 
bythe designers with the related capability 
read in ess level (CRL) assessments made by 
the FDS's for the various WBS products. 
(The TRL cannot be higher than the un- 
derlying CRL of the knowledge elements 
on which the product depends) Further, it 
is effective for planning technology pro- 
grams and managing the associated risks, 
assessing technology maturation progress 
and readiness for deployment and for vali- 
dating the programmatic and technical 
readiness of organizational capabilities to 
execute a program or project. 
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